IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



In re Application of Atty. Docket 

GERARD DE HAAN ET AL. NL 010094 

SERIAL NO,: GROUP ART UNIT: 

FILED: CONCURRENTLY EXAMINER: 

MOTION ESTIMATOR FOR REDUCED HALOS IN MC UP-CONVERSION 

Commissioner for Patents 
Washington^ D.C. 20231 

Sir: 

PRELIMINARY AMENDMENT 
Prior to calculating the filing fee and examination, 
please amend the above-identified application as follows: 



IN THE CLAIMS 
Please amend the claims as follows: 
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1. {Amended} A method for detecting motion at a temporal 
intermediate position between previous and next images^ in which a 
criterion function for candidate vectors is optimized;, said 
function depending on data from both previous and next images and 
in which the optimizing is carried out at the temporal intermediate 
position in non-covering and non-uncovering areas, characterized in 
that the optimizing is carried out at the temporal position of the 
next image in covering areas and at the temporal position of the 
previous image in uncovering areas. 

2. (Amended) The method as claimed in claim 1, wherein the 
previous image is shifted over a fraction a times the candidate 
vector, the next image is shifted over 1 -a times the candidate 
vector and the fraction a may change within the image period. 

3. (Amended) The method as claimed in claim 1, wherein the 
criterion function is a match error which is minimized. 

4. (Amended) The method as claimed in claim 2, wherein the 
fraction a is controlled by a covering/uncovering detector in the 
matching process. 
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5. (Amended) The method as claimed in claim 4, wherein the 
fraction a is set to 1 in case of covering and set to 0 in case of 
uncovering. 

6. (Amended) The method as claimed in claim 4, wherein the 
covering/uncovering detector decides on data in a previous image to 
the fraction a in the current estimation. 

7. (Amended) The method as claimed in claim 1, wherein a 
velocity edge Xe is determined, an occlusion area is marked around 
said edge, and in said occlusion area, foreground velocity is 
replaced by background velocity or reversibly dependent on whether 
the occlusion area is a covering or uncovering area, the sign of 
the foreground velocity and on which side of the velocity edge Xe 
the foreground is, 

8. (Amended) The method as claimed in claim 7, wherein at the 
position Xj of a velocity edge 

• a first position in the previous (covering) or next 

(uncovering) image is calculated by shifting over the first 
vector at one side of the edge 
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• a second position in the previous (covering) or next 

(uncovering) image is calculated by shifting over the second 
vector at the other side of the edge 

• and a third intermediate position between x^ and x^ is 
10 calculated 

• while finally, the vector fetched with at the third position 
in the previous (covering) or next (uncovering) image is filled in 
those regions of the image in the environment of the edge, to which 
no vector is projected, in case the background vector v-^ should be 



Igi filled in, and the vector chosen between 



,n) and D(x + 



,n) 



10. 

which is most different from is filled in, in case a foreground 



vector v^^ should be filled in. 



9. (Amended) The method as claimed in claim 8, wherein the 

intermediate position is (x^ + x^)/2. 



10. (Amended) The method as claimed in claim 7, wherein a 
background velocity is identified as a velocity which crosses the 
velocity discontinuity and projects to a foreground velocity in the 
previous picture, whereas a foreground velocity projects to itself. 
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11. (Amended) The method as claimed in claim 1, wherein near 
edges it is tested whether the mentioned edge has moved over the 
first vector on one side of the edge, or over the second vector on 
the other side of the edge, in case the edge moves with the first 
(second) vector, the second (first) vector is filled in those 
regions of the projected vector field in the environment of the 
edge, to which no vector is projected, in case a background vector 

should be filled in, and the other vector is filled in, in case 

a foreground vector Vp^ should be filled. 

12. (Amended) The method as claimed in claim 10, wherein the 
crossing from a background region to a foreground region in the 
previous image is verified by the match error of the vector in that 
block. 

13. (Amended) An apparatus for detecting motion at a temporal 
intermediate position between previous and next images, comprising 
means for optimizing a criterion function for candidate vectors, 
said function depending on data from both previous and next images 
in which the optimizing is carried out at the temporal intermediate 
position in non-covering and non-uncovering areas, characterized in 
that said apparatus further comprises means for detecting covering 
or uncovering areas, wherein the optimizing is carried out at the 
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temporal position of the next image in covering areas and at the 
temporal position of the previous image in uncovering areas. 

14. (Amended) The apparatus as claimed in claim 13, wherein the 
previous image is shifted over a fraction a times the candidate 
vector, the next image is shifted over 1 -a times the candidate 
vector and the fraction a may change within the image period. 

15. (Amended) The apparatus as claimed in claim 13, wherein the 
criterion function is a match error which is minimized. 

16. (Amended) The apparatus as claimed in claim 14, wherein 
said apparatus further comprises a covering/uncovering detector for 
controlling the fraction a in the matching process. 

17. (Amended) The apparatus as claimed in claim 16, wherein the 
fraction a is set to 1 in case of covering and set to 0 in case of 
uncovering. 

18. (Amended) The apparatus as claimed in claim 16, wherein the 
covering/uncovering detector decides on data in a previous image to 
the fraction a in the current estimation. 
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19. (Amended) The apparatus as claimed in claim 13^ wherein a 
velocity edge Xe is determined, an occlusion area is marked around 
said edge, and in said occlusion area^ foreground velocity is 
replaced by background velocity or reversibly dependent on whether 
the occlusion area is a covering or uncovering area, the sign of 
the foreground velocity and on which side of the velocity edge Xe 
the foreground is. 

20. (Amended) The apparatus as claimed in claim 19, wherein 
said apparatus further comprises calculation means for, at the 
position of a velocity edge, calculating 

• a first position in the previous (covering) or next 

(uncovering) image by shifting x^ over the first vector at one side 
of the edge 

• a second position x^ in the previous (covering) or next 

(uncovering) image by shifting x^ over the second vector at the 
other side of the edge 

• and a third intermediate position between x^ and x^ , 

• while finally, the vector fetched with at the third position 
in the previous (covering) or next (uncovering) image (9) is filled 
in those regions of the image in the environment of the edge, to 
which no vector is projected, in case the background vector 
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should be filled in, and the vector chosen between D{x- 




n) and 



- - (A 

D(x-h ^n) which is most different from is 



filled in, in case a 



foreground vector should be filled in. 



21. 



(Amended) 



The apparatus as claimed in claim 20, wherein the 



intermediate position is (x^ + x^)/2. 



22. 



(Amended) 



The apparatus as claimed in claim 19, wherein 



said apparatus further comprises means for projecting two positions 
on either side of the edge to the previous (covering) or next 
(uncovering) image, in which a background velocity is identified as 
a velocity which crosses the velocity discontinuity and projects to 
a foreground velocity in the previous picture, whereas a foreground 
velocity projects to itself. 

23. (Amended) The apparatus as claimed in claim 19, wherein 
said apparatus further comprises means for testing near edges 
whether the mentioned edge has moved over the first vector on one 
side of the edge, or over the second vector on the other side of 
the edge, in case the edge moves with the first (second) vector, 
the second (first) vector is filled in those regions of the 
projected vector field in the environment of the edge, to which no 
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vector is projected, in case a background vector v^^ should be 
filled in, and the other vector is filled in, in case a foreground 
vector v^^ should be filled, 

24. (Amended) The apparatus as claimed in claim 22, wherein 
said apparatus further comprises verification means for verifying 
the crossing from a background region to a , foreground region in the 
previous image by the match error of the vector in that block. 

25. (Amended) An image display apparatus comprising apparatus 
for detecting a motion vector as claimed in claim 13, means for 
interpolating image parts connected to said detecting apparatus, 
and a display device connected to the interpolating means. 
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REMARKS 

The claims have been amended to more clearly define the 
invention as disclosed in the written description. In particular, 
claim 19 has been made a proper singularly dependent claim 
depending from claim 13, In addition, the claims have been amended 
for clarity. 

When the Examiner takes this case up for examination, it 
is respectfully requested that this Preliminary Amendment be taken 
into consideration. 



Respectfully submitted. 




Attorney 

Tel.: 914-333-9611 
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APPENDIX 

1. (Amended) M e thod A method for detecting motion at a 
temporal intermediate position between previous and next images, in 
which a criterion function for candidate vectors is 
optimigGd optimized ^ said function depending on data from both 
previous and next images and in which the optimising optimizing is 
carried out at the temporal intermediate position in non-covering 
and non-uncovering areas, e hargctcriG c d characterized in that the 
optimising optimizing is carried out at the temporal position of 
the next image in covering areas and at the temporal position of 
the previous image in uncovering areas. 

2. (Amended) Method accord ing to The method as claimed in claim 
1, wherein the previous image is shifted over a fraction a times 
the candidate vector, the next image is shifted over 1 -a times the 
candidate vector and the fraction a may change within the image 
period. 

3. (Amended) Method according to The method as claimed in 
claim 1, wherein the criterion function is a match error which is 
minimisedm inimized . 
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4 - (Amended) Metho d Qccording to The method as claimed In 

claim If wherein the fraction a is controlled by a 
covering/uncovering detector in the matching process. 



5. (Amended) M et hod according to The method as claimed in 
claim Af wherein the fraction a is set to 1 in case of covering and 
set to 0 in case of uncovering. 

6. (Amended) M e t h od Qcco-rdi ng to The method as claimed in 
claim A, wherein the covering/uncovering detector decides on data 
in a previous image to the fraction a in the current estimation, 

7. (Amended) Method accord ing to The method as claimed in 
claim 1, wherein a velocity edge Xe is determined, an occlusion 

O area is marked around said edge_^ and in said occlusion area^ 
foreground velocity is replaced by background velocity or 

ill 

£1 reversibly dependent on whether the occlusion area is a covering or 
uncovering area, the sign of the foreground velocity and on which 
side of the velocity edge Xe the foreground is. 

8. (Amended) M e th o d ac c ordi ng to ■ The method as claimed in 
claim 7, wherein at the position of a velocity edge 



m 
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• a first position in the previous (covering) or next 

(uncovering) image is calculated by shifting over the first 
5 vector at one side of the edge 

• a second position x^ in the previous (covering) or next 

(uncovering) image is calculated by shifting Xj over the second 
vector at the other side of the edge 

• and a third intermediate position between and x^ is 
10 calculated 

• while finally, the vector fetched with v^^ at the third position 



IS in the previous (covering) or next (uncovering) image is filled in 

Ul those regions of the image in the environment of the edge^ to which 

III 

2; no vector is projected, in case the background vector v^-^v^ should 



be filled in^ and the vector chosen between D\x- 



,n) and Z>(x + 



which is most different from is filled in, in case a foreground 



vector should be filled in. 



9. (Amended) M et h o d according to The method as claimed in 
claim 8, wherein the intermediate position is ( + x^)l2. 

10. (Amended) Me t ho d according to The method as claimed in 
claim 7, wherein a background velocity is identified as a velocity 
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which crosses the velocity discontinuity and projects to a 
foreground velocity in the previous picture, whereas a foreground 
velocity projects to itself. 

11. (Amended) M e thod accordin g to The method as claimed in 
claim If wherein near edges it is tested whether the mentioned edg 
has moved over the first vector on one side of the edge, or over 
the second vector on the other side of the edge, in case the edge 
moves with the first (second) vector, the second (first) vector is 
filled in those regions of the projected vector field in the 
environment of the edge, to which no vector is projected, in case 

background vector should be filled in, and the other vector is 
filled in, in case a foreground vector should be filled. 

12. (Amended) M e thod according to The method as claimed in 
claim 10, wherein the crossing from a background region to a 
foreground region in the previous image is verified by the match 
error of the vector in that block. 

13- (Amended) Apparatus ' A n apparatus for detecting motion at a 
temporal intermediate position between previous and next images, 
comprising means -(-3r^ — optimising for optimizing a criterion function 
for candidate vectors, said function depending on data from both 
previous and next images in which the optimising optimizing is 
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carried out at the temporal intermediate position in non-covering 
and non-uncovering areas ^ -e haractcriG c d characterized in that said 
apparatus further comprises means for detect i o n detecting covering 
or uncovering areas / wherein -{^ — ar e pr ovided and that the 
optimiGing optimizing is carried out at the temporal position of 
the next image in covering areas and at the temporal position of 
the previous image in uncovering areas. 

14- (Amended) A ppara tus according to The apparatus as claimed 
in claim 13, wherein the previous image is shifted over a fraction 
a times the candidate vector, the next image is shifted ove;r 1 -a 
times the candidate vector and the fraction a may change within the 
image period. 

15. (Amended) Apparatus — according to The apparatus as claimed 
in claim 13, wherein the criterion function is a match error which 
is minimiscd m inimized . 

16. (Amended) App a ratu s — acc or ding to The apparatus as claimed 
in claim 14, wherein said apparatus further comprises a 

cover ing/uncovering detector for controlling the fraction a 4rer 
controll e d b y a coveri n g/ un e ovGri ng detector ( 2 -) in the matching 
process , 
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17. (Amended) Ap parat uo ace o rding to The apparatus as claimed 
in claim 16^ wherein the fraction a is set to 1 in case of covering 
and set to 0 in case of uncovering. 



18. (Amended) Apparatu s ac co rding to The ap paratus as claimed 
in claim 16, wherein the covering/uncovering detector — decides 
on data in a previous image to the fraction a in the current 
estimation . 



19. (Amended) Apparatus according to one of the preceding 

^ claims The apparatus as claimed in c laim 13^ wherein a velocity edge 

III Xe is determined, an occlusion area is marked around said edge^ and 

m in said occlusion area^ foreground velocity is replaced by 

|g background velocity or reversibly dependent on whether the 

gj occlusion area is a covering or uncovering area, the sign of the 

Li foreground velocity and on which side of the velocity edge Xe the 

f;| foreground is. 

20. (Amended) Apparatus acco r ding to The apparatus as claimed 
in claim 19, wherein said apparatus further comprises calculation 
means ■(■ 5 , 6 , 8) ar e provid e d ' for, at the position of a velocity 
edge, calculating 
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• a first position in the previous (covering) or next 

(uncovering) image by shifting over the first vector at one side 
of the edge 

• a second position x^ in the previous (covering) or next 

(uncovering) image by shifting x^ over the second vector at the 
other side of the edge 

• and a third intermediate position between x^ and x^ ^ 

• while finally, the vector fetched with at the third position 
in the previous (covering) or next (uncovering) image (9) is filled 
in those regions of the image in the environment of the edge, to 
which no vector is projected, in case the background vector v^^^jq 



should be filled in, and the vector chosen between D{x- 



^1^ 



n) and 



D(x + 



n) which is most different from is filled in, in case a 



foreground vector v^^ should be filled in. 



21. (Amended) Apparat uG ac co rding to The apparatus as claimed 
in claim 20, wherein the intermediate position is {x^ + x^)/2. 

22. (Amended) Apparatus acc ording to The apparatus as claimed 
in claim 19, wherein said apparatus further comprises means 
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(lO^l-Daro providod for projecting two positions on either side of 
the edge to the previous (covering) or next (uncovering) image, in 
which a background velocity is identified (14 ) as a velocity which 
crosses the velocity discontinuity and projects to a foreground 
velocity in the previous picture^r whereas a foreground velocity 
projects to itself. 

23. (Amended) Apparatus according to The apparatus as claimed 
in claim 19, wherein said apparatus further comp rises means (-20) 
arc provid e d for testing near edges whether the mentioned edge has 
moved over the first vector on one side of the edge, or over the 
second vector on the other side of the edge, in case the edge moves 
with the first (second) vector, the second (first) vector is filled 
in those regions of the projected vector field in the environment 
of the edge, to which no vector is projected, in case a background 

vector should be filled in, and the other vector is filled in, 
in case a foreground vector Vp^ should be filled, 

24, (Amended) A ppara tus ■ according to The apparatus as claimed 
in claim 22, wherein said apparatus further comprises verification 
means arc provid e d for verifying the crossing from a background 
region to a foreground region in the previous image by the match 
error of the vector in that block. 
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25. (Amended) Imaerc A n image display apparatus comprising 
detection apparatus -fSi^for detoction detecting a motion vector 
,-iccordina to as claimed in claim 13, means (22) for interpolating 
image parts connected to said detection detecting apparatus,^ 
and a display device (23) connected to the interpolating means. 
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